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AN EXPLICIT SOLUTION FOR AN OPTIMAL 
STOPPING/OPTIMAL CONTROL PROBLEM 
WHICH MODELS AN ASSET SALE^ 

By Vicky Henderson and David Hobson 

Warwick Business School and University of Warwick 

In this article we study an optimal stopping/optimal control 
problem which models the decision facing a risk-averse agent over 
when to sell an asset. The market is incomplete so that the asset 
exposure cannot be hedged. In addition to the decision over when to 
sell, the agent has to choose a control strategy which corresponds to 
a feasible wealth process. 

We formulate this problem as one involving the choice of a stop- 
ping time and a martingale. We conjecture the form of the solution 
and verify that the candidate solution is equal to the value function. 

The interesting features of the solution are that it is available 
in a very explicit form, that for some parameter values the optimal 
strategy is more sophisticated than might originally be expected, and 
that although the setup is based on continuous diffusions, the optimal 
martingale may involve a jump process. 

One interpretation of the solution is that it is optimal for the 
risk-averse agent to gamble. 

1. Introduction. The aim of this article is to study a mixed optimal 
stopping/optimal control problem which arises in a natural way in finance 
as a mixed investment/sale problem in an incomplete market. 

The mathematical problem and its solution have several interesting fea- 
tures. First, we can find an explicit solution and this is especially pleasing 
since the problem is multidimensional, although it does possess certain nat- 
ural scalings. Second, the form of the solution is unexpected, and turns out 
to be more complicated than naive intuition might expect. In a sense to 
be made precise later, even though the objective function is concave, the 
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choice over stopping times induces an unexpected convexity. Third, the op- 
timal strategy has novel mathematical features, and although the setup is 
based on continuous processes, the optimal control involves a combination 
of jumps and local times on rays. 

There is a long history of problems from finance, such as those concern- 
ing portfolio optimization (Merton [9]) and in American options (Samuel- 
son/McKean [12]) being converted into problems in stochastic control and 
optimal stopping. Examples of mixed stopping/control problems include 
Henderson [3], Karatzas and Kou [5], Karatzas and Sudderth [7], Karatzas 
and Wang [8] and Karatzas and Ocone [6]. 

The situation that motivates our study is that of a risk-averse^ agent who 
has an asset to sell at a time of her choosing, and who wishes to choose 
the sale time so as to maximize the expected utility of total wealth at that 
moment. Here total wealth includes both the revenue from the sale, and 
the value of any other assets. This is an example of a problem from "Real 
Options" (see, e.g.. Dixit and Pindyck [1]) where an asset is described as real 
in order to distinguish it from a financial asset which may be dynamically 
hedged on a market. In the language of financial economics, the asset is 
not redundant,'^ and the market is incomplete. Although our problem can 
be stated as an abstract stochastic control problem, we will often use the 
language of financial mathematics, such as describing the objective function 
as a utility function, and the controlled process as a wealth process. Our 
intuition for the solution will partly come from the application to finance. 

We consider two versions of the problem. In the simpler version, the agent 
has a simple optimal stopping problem of when to sell the real asset, and 
other wealth is constant. (We work with the bank account as numeraire, and 
imagine in that case that the agent has no outside investment opportunities.) 
In the extended version, the agent has the possibility to invest her other 
wealth. If she could choose investments which displayed correlation with the 
real asset, then she could reduce her risk exposure, by selling the financial 
asset if necessary. Similarly, if she could choose investments with nonzero 
expectation, then she could increase her expected returns. In either case we 
would expect her to be able to increase her expected utility. 

We rule out both of these possibilities by insisting that the set of available 
investments are uncorrelated with the real asset, and that they are fair. (In 
terms of the mathematical statement of the problem, this means that the 
set of available controls are martingales which have zero covariation with 
respect to the price process of the real asset.) At first sight it appears that 



^For our purposes (see also Miiller and Stoyan [10]) a risk-averse agent is one who, 
offered the choice between the certain yield E[Z] and the risky prospect both payments 
to be made at a future time T, prefers the certain payout, whatever the distribution of Z. 

^An asset is redundant if its payoffs can be replicated through other securities. 
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there is no way that an agent can make use of these extra opportunities. 
However, we find that this is not the case, and that the presence of the timing 
option to sell the real asset means that the risk-averse agent becomes risk- 
seeking. Effectively the agent chooses to gamble. Thus our model provides 
a rational explanation for gambling, albeit in a specialized setting, without 
recourse to nonconcave utilities, inaccurate assessments of probabilities, or 
other irrationalities. 

The remainder of the paper is structured as follows. In the next section we 
give a mathematical formulation of the problem and state the main result. 
The problem with no investment opportunities is the subject of Section 3, 
and the situation where additional fair investments or gambles are available 
is contained in Section 4. In both of these sections we consider an agent 
with a utility with constant relative risk aversion coefficient less than 1. The 
results are extended to the case i? > 1 in Section 5. This involves considerable 
extra work as an easy proof that a local martingale is a supermartingale 
which is valid for i? < 1 is no longer valid in this case. Section 6 contains 
the logarithmic utility case together with concluding remarks. 

2. Utility maximization with discretionary stopping. 

2.1. Preliminaries. The generic problem (in the next subsection we will 
be both more precise and more explicit) is to find 



where r is a stopping time, Xt is a stochastic control chosen from a space 
X of feasible strategies, and Y is an exogenous Markov process. In the 
terminology of Karatzas and Wang [8] the stopping time r is discretionary 
in the sense that it is chosen by the agent. 

The problem (1) should be compared with the problem in Karatzas and 
Wang [8] [see (5.1) and (5.3)]. In some ways (1) is simpler, not least because 
it focuses completely on utility of terminal wealth, whereas the formulation 
in Karatzas and Wang includes utility from consumption. (However, in terms 
of the general setup of this subsection, it is clear that we too could include 
a consumption term.) A further difference is that Karatzas and Wang place 
an explicit interpretation on X as the gains from trade from an investment 
strategy in a multi-asset, frictionless market. Again, this difference is largely 
cosmetic, and although we are not similarly explicit, this interpretation is 
also the one we have in mind. The main motivation for the more general 
definition of X is so that optimal strategies will exist. 

Instead, there are two fundamental differences between the problem in (1) 
and the problem in Karatzas and Wang [8]. First, these latter authors assume 
that U has no Y dependence and takes the particular form U{t,x,y) = 



(1) 
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e~f^U{x). Second, they work in a complete market in which the traded 
financial assets span the uncertainty set in the model. In contrast, in our 
setup the auxiliary process Y (representing the price of the asset to be sold) 
enters into the optimization problem, but is not part of the financial market, 
so that the model is not complete. Indeed, the formulation (1) can itself be 
seen as a special case of a more general problem in which U is random. 

2.2. Problem definition. The idea is that X represents the wealth process 
of an agent, and that Y represents the price process of a real asset. The agent 
owns a single unit of the real asset. At the moment r of the agent's choosing 
at which the real asset is sold, the wealth of the agent increases from X^- to 
Xr + Yt-. The objective of the agent is to maximize the expected (increasing, 
concave) utility of wealth, evaluated at r. 

Let Y be modeled by an exponential Brownian motion with dynamics 

(2) dYt = Yt{adWt + fidt), Yo = y>0, 

which is specified exogenously. It is convenient to set = jl. 

The fundamental problem is to select a stopping time r and a stochastic 
process Xt from the set X where 

^ = {Xt:E[Xo]=x;X„ + y„>0, n < r; 

X is a cadlag martingale such that [X, y]t = 0} 

so as to solve (for y > and x > —y) 

(4) v3 = V3[x,y)= sup nUR{Xr + Yr)\Xo = x,Yo = y], 

T,X&X 

where the objective function U is given by 

n^-^ - 1 

(5) U{u) = Ur{u) = — — , i?G(0,oo), 

i — xl 

In particular we want to compare the solution to (4) with 

(6) K" = V:ix,y) = snvnUnix + Y^)\Yq = y], 

r 

where again the domain of is (y > 0, x + ?/ > 0). If x > in (6), then r is 
unrestricted; otherwise for x < we are only interested in the case rr + ?/ > 
and we insist that r < infju : Yu = —x}. 

Note that we do not work on a given probability space, but rather we are 
allowed to design a model (0,.F, P) with associated filtration F^, provided 
we do this in a way such that W is an F^-Brownian motion. (In the same 
spirit Karatzas and Ocone [6] consider the probabilistic model as part of the 
solution, and call such a model policy supporting.) 



A MODEL FOR AN ASSET SALE 



5 



The superscript g on the value function denotes the fact that the (wealth) 
process X is a martingale, or equivalently that the process X is the wealth 
resulting from a series of fair gambles. The superscript n is an abbreviation 
for the no-gambling case. Furthermore, the slightly nonstandard form of the 
utility function is chosen so that in the limit i? ^ 1 we recover logarithmic 
utility: recall that limi^^i(a;^~'^ — — R) = Inx. As a result the case of 
logarithmic utility U (x) = In a; can be recovered immediately in the limit 

The solution to (2) is given by Yt = ye"^t+h-'^Wtn where 7 = 2fi/a'^. 
The interesting case is when < 7 < 1. In this case Y , which is our model 
for the real asset, is increasing in expectation, but does not increase to 
infinity almost surely. The fact that Y has positive drift gives an incentive 
to hold onto the real asset, which is counterbalanced by the risk of price 
fluctuations resulting from a delayed sale, to give a nondegenerate problem. 
Further, in the case 7 < 1 we have that Y tends to zero almost surely. 

Note that in both (4) and (6) we do not want to insist that stopping 
time r is finite [and indeed, for < 7 < 1 it will turn out that < P(r < 
00) < 1 for the optimal stopping rule]. However, we do need to be sure 
that Y\m{Xtf\T + ^at) and lim(x + ItAr) exist as t increases to infinity. The 
existence of the latter limit is guaranteed for 7 < 1 since If — > almost 
surely as t — > 00. Further, the condition Xtf^r + ^ provides a bound 
on X from below, and as we shall see this is sufficient to give a limit for 

{^tAr + Ytfxr)- 

The definition of the set X of admissible wealth processes reflects several 
features. The fact that the quadratic variation [X, y] = is a formalization 
of the idea that there are no hedging instruments for Y . The martingale 
assumption reflects the fact that the wealth process X is the gains process 
from a series of fair gambles. (In the financial setting it might be appro- 
priate to replace the martingale condition with a condition that X is a 
supermartingale. It should be clear that this does not change the results.) 
The condition X^ + Yu>Q for u < r is a natural restriction and rules out 
doubling strategies and gambling for resurrection. Finally, the cadlag as- 
sumption is a regularity condition to assume that certain quantities are well 
defined. 

Note that many of these assumptions can be relaxed but at the cost 
of losing the explicit solution, and of losing the context within which our 
result (see Corollary 3 below) is so counterintuitive. For example (see Evans, 
Henderson and Hobson [2] ) if we suppose that X is the gains from trade from 
an investment strategy in a traded asset P, then we may have that P (and 
thence X) is correlated with y, or that P (and thence X) has nonzero drift. 

2.3. Main results. In this section we state the main result in the case 
i? < 1. The proof of this result will follow from the analysis in the next two 
sections. 
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Recall that we are interested in the solutions to (4) and (6), and especially 
when these two solutions are different. It turns out that there is a transition 
in the form of the solution at a particular value of 7, namely 7_ . 

Definition 1. Let TR{'y) be given by 

Tr{j) = {R- ^f{R + 1 - 7) - (2fi - 7)^(1 - 7), 
and let 7_ = 7-(ii) be the unique solution in (0, i? A 1) of r/j(7) = 0. 

For two value functions V^^\ V^'^^ defined on {y > 0,x + y > 0) we write 
= -j/(2) if T/(i)(x,y) = V^^\x,y) for ah pairs {x, y) and V^^^ < F^^) if 
V^^\x,y) < V^'^\x,y) for aU pairs {x,y) with strict inequality for some pair. 

Theorem 2. Suppose R<1. For 7 < 7-(i?) (and for ^ > R) we have 
that KT = ^* ■ Conversely, for 7_ < 7 < we have that < V/. 

The results in the case R>1 are broadly similar; see, for example, Theo- 
rem 14. However, the fact that the objective function is not bounded below 
when R>1 introduces some serious complications. For this reason we defer 
consideration of this case until we have studied the case i? < 1 in full detail. 

In terms of the financial asset sale problem. Theorem 2 has the following 
corollary: 

Corollary 3. Suppose R<1. For 7 < 7-(-R) the solution to the opti- 
mal selling problem is the same whether or not the agent has access to fair 
gambles. For 7„ < 7 < i? the risk-averse agent can improve her utility by 
undertaking fair gambles. 

The main result of Corollary 3, namely that the agent can benefit from the 
opportunity to make alternative investments, would not be a surprise if ei- 
ther the investments facilitated hedging, or if the investments were beneficial 
in their own right. However, by insisting that these additional investments 
have zero return, and that they are uncorrelated with the real asset, we have 
ruled out both of these motives for outside investment. If the real asset value 
Y was constant, or if r was fixed and predetermined, then there would never 
be a benefit to be obtained from nonconstant x, and the agent would never 
gamble. 

Instead, there are three key elements in our model which are necessary 
for the main conclusion that gambling can be beneficial. These are that 
the market is incomplete, so that exposure to fluctuations in Y cannot be 
fully hedged, that the real asset is indivisible, and that the asset sale is 
irreversible. However, it remains a surprise that these features are sufficient 
to induce a risk-averse agent to gamble. 
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3. Calculation of solution with constant wealth. We begin by deriving 
the solution to (6) in the case < i2 < 1. Rather than writing down a varia- 
tional problem (HJB equation) we postulate that the optimal stopping rule 
belongs to a natural candidate family. We calculate the value function for 
the optimal element of this family, and then use a verification argument to 
show that we have solved the original problem. In fact the class of stopping 
rules we will consider are the first times that Y exceeds some large level. 

Given the time-homogeneity of the problem, it is natural that the opti- 
mal stopping region should be independent of time. Further, increased Y is 
associated with greater risks so a natural candidate for the optimal stop- 
ping time is the first time that Y exceeds a given level. To this end, for 
<w <x/y define 

Tw = inf{n > : y„ > x/w}. 

Suppose 7 < 0. Then, for all r, E[U{x + Yr)] < U{x + E[y^]) < U{x + 
y) = E,[U{x + Yq)]. Thus r = is optimal. In financial terms the asset Y is 
depreciating and since there is also a risk inherent in waiting to sell the asset 
and U is concave, it is optimal to choose r as small as possible. 

Now suppose 7 > 1. Suppose x > 0. Then < oo for arbitrarily small w 
and VJ'{x,y) > U{x{l + 1/w)). It follows that VJ'{x,y) = oo. To deal with 
the case x < 0, for < < \x\/y define 

f„ = inf{u >0:Yu = \x\/v}, 

and set fi = inf {u >0:Yu= \x\}. Then, for v < \x\/y, 

E[U{x + Yf,^fJ] 

1 1 



(7) 



\1-R/ 



(-l + l/^;)i-«)P(f,<n). 



We can use the scale function of Y to calculate (for 7 > 1), P(f„ < "^i) = 
(|x|i-^ - y^-'y) /(|x|^-^(l - u'^"^)), and then E[U{x + Yr^^rJ] tends to infin- 
ity as V tends to zero. [For 7 = 1 we have ¥(fy < fi) = (Iny — In |2;|)/(— Inu) 
with the same conclusion.] Hence V^{x,y) = 00 for 7 > 1. 

The case < 7 < 1 is also degenerate in a similar fashion. Define F{w) = 
E[U{x-\-Yt-^)], and recall that for 7 < 1, 1^ — > 0. Then, for x > and y <x/w, 

F{w) = V, _ p ^ P(r^ = 00) + < 

(8) 



+ {(1 + l/wf-^ - l}{wy/xf~'i] - 1 



l-R 



On differentiating we have 



F'iw) 



11 \ 



(1-7) 



-R^ 



l-R 



w 
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and since, for w > 

> (i + i/wY 



^i±lM:^>a + i/.)---i, 



w 

it follows that for < 7 < 1, F is a decreasing function. Then V^{x,y) > 
lim^lQ F{w) = 00. If X < 0, the argument of the previous paragraph still 
applies and V"{x,y) = 00. The case x = is also easily dealt with. 

If 7 = ii < 1 and a; > 0, then V^{x,y) > lim^^o -^(^^) = {x^~^ + y^~^ - 
1)/(1 — R). Conversely, it follows from the twin facts that (x + y)^^^ < 
x^^^ + y^~^ and that Y^~^ is a nonnegative martingale, that K[Ur{x + 
Yr)] < E[{x^-^ + Y^-^ - 1)/(1 - R)] < {x^-^ + y^-^ - 1)/(1 - R). Hence 
VJ^{x,y) = {x^~^ + y^^^ — 1)/(1 — R). Further, if x < 0, then it is easy to 
check using Ito's formula that {x + Yt)^~^ is a positive supermartingale, and 
hence V:^{x, y) = {{x + yf-^ - 1)/(1 - R). 

It remains to consider the nondegenerate case, which is covered in the 
following results. 

Definition 4. For Q <w <oo define K{w) by 



(9) AH = (1-7)- 



l-R w 



Lemma 5. For < 7 < i? < 1 there is a unique solution w* to A{w) = 0, 
and w* <{R- 7)/7. 

Proof. On differentiation we see that A has a unique turning point 
at w = {R — 7)/7, and that this turning point is a minimum. Further, 
lim^^o A(tL') > = lim^„^oo A(^y). It then follows that {R — j)/j>w* where 
w* is the unique positive solution to A{w) =0. □ 

For w > define via: for y > x/w, 

(x + y)^"-^- 1 



1-R 



(10) V^{x,y) 
and for y < x/w, 

^ ^ ^'^^ 1-R \ X J 1-R 

Note that for y < x/w, V^{x,y) = F{w). 

Proposition 6. Suppose R<1. 

For aU'y<0, V;^{x,y) = {{x + y)^~^ - 1)/{1 - R). 

For all 7 > i?, Kr(x,y) = 00. 
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For-i = R, V^{x,y) = {x^''^ + y^-^-l)/{l-R) forx>0 andV^{x,y) = 
{{x + y)^-^-l)/{l-R) forx<0. 

In the nondegenerate cases < 7 < i?, = , where w* is the unique 
positive solution to A{w) = 0. 

Proof. We cover the case < 7 < i?, the other cases having been cov- 
ered in the discussion before the statement of the proposition. We need to 
show that = KT, where VJ^ is the solution to the problem in (6). 

Lower bound. If x < w*y, then V'^{x, y) > U{x + y) = (x, y). Other- 
wise X is certainly positive, and for w < x/y and for the stopping rule 
we have E[C/(x + Yr^)] = F{w) where F is as given in (8). For < 7 < i? 
the equation F'{w) = has a unique solution w* in (0, 00), and it is easy to 
see that this solution corresponds to a maximum of F. Then, for x > w*y, 
V,^ix,y)>F{w*) = V^*ix,y). 

Upper bound. It is an exercise in one-dimensional calculus to show that 
satisfies (a subscript y denotes partial differentiation) 

(12) V^'{x,y)>UR{x + y), 

(13) i^yVy^' + ^aVVy^; <0, 

with equality in (12) for y > x/w* , and equality in (13) for y < x/w* . In 
particular, for y > x/w* 

^yVf + y = (x + y)-(«+i)/|7^ - (i? - 7)} 

and this expression is negative, since by Lemma 5, w* < (i? — 7)77. Further, 
using the definition of w* , is continuous at y = x/w* and equal to 
x-^{l + l/w*)-^. 

By Ito's formula, for any pair of initial values (x,y) and for any stopping 
time r, 

et/\T 

y"'*(x,yjAr) = ^"^{x.y) + iiiYsVf {x,Ys) + \a^Y!v^;{x,Ys))dt 

rtAr 

+ aYtVy^*{x,Ys)dWs 

rtAr 

< V"' (x, y) + aYsV^ (x, Y^) dWs. 

The right-hand side of this expression is a local martingale which is bounded 
below [by F"'*(0,0) = —1/(1 — R)] and hence is a supermartingale. Then, 
using (12), 

Ey[UR{x + Yt^r)]<^''[V'"*{x,Yt^r)] 
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riAr 

<V''"'{x,y)+Ey' 



ft/\T 

aYsV^\x,Ys)dWs 



<V^\x,y). 

Letting t} oo and using Fatou we conclude V^{x^y) < {x,y). □ 

4. Calculation of the solution with gambling. The strategy of this section 
is similar to that in the previous section. We exhibit a parametric family of 
combined stopping rules and admissible martingales Xt. For each element in 
the family we calculate the associated value function, and then we optimize 
over the parameter values. This gives a lower bound on Vj' . Finally we show 
that this lower bound is also an upper bound. 

Recall that we are assuming R<1. In order to rule out degenerate solu- 
tions we assume that 7 < 1. 

4.1. Definition of a family of candidate strategies. Fix —1 < ^ <r] with 
r/ > 0. The aim is to specify a stopping rule r = t"^'^ and a martingale X = 

Suppose first that x < ^y. In this case we take r = 0, and Xq = x. Now 
suppose < X < rjy. Let Xq be the random variable such that Xq = rjy with 
probability (x — S,y)/i{v ~ Ov) Xq = ^y otherwise. Then E[Xo] = x. On 
Xq = ^y, take r = 0. Finally, if x > rjy, set Xq = x. In all cases we have that 
the sets r > and Xq > rjy are identical. 

Hence we may suppose that Xq > 7]y. Define Lt = {maXs<tYs — Xo/r/)"'". 
[We use the label L, since by Skorokhod's lemma, L is proportional to the 
local time the process {Xt,Yt) spends on the ray Xs =rjYs, where X is 
defined below.] Note that L is an increasing process and define 

77 /■* dLu 

At 



iv-OJo Yu 

Let be a standard Poisson process, independent of y, and define Xt via 

(14) Xt = XQ+ /|;v^^. =0}^ dLs - =Q}Ys{7] - dNA, . 

It follows that [X, Y]t = 0. Associated with Xt will be the stopping rule 

(15) T'''« = sup{n:A^^„=0}, 

so that if X ever jumps, then the real asset is sold. For this reason we 
concentrate on the process while A^At_ = 0. 

Provided N^^ = we have that Xt = Xq + rjLt. It follows that X only 
increases when L increases (which can only occur when 1" is at a maximum), 
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and at those times Lf = Yt — Xq/t], so that Xf = r]Yt. Then, taking the 
derivative form of (14), and substituting for dLt, 

dXt = {ridLt -Ytin- i) dNA,)I{N^^_=o} 

= -Y{r,-i){dNA,-dAt)I{M^^_=o}- 

It fohows immediately that X is a local martingale, and the true martingale 
property follows since X is bounded above and below by constant multiples 
of the maximum of the exponential Brownian motion Yt- 

Furthermore, it is also the case that the value of X can decrease only 
when Xt- = ijYt. To see this, note that can only jump at a point of 
increase of At, and this can only happen when L is increasing, so that as 
before (but now using the right-continuity of paths) = rfYt. When X 
jumps, it jumps down from Xt- = rjYt to 

Xt = Xt- - Ytiv -0= riYt - Ytiv - 6 = ^Yt- 

Observe also that Xt + Yt > {1 + C)Yt > ioi t < r'''^. The definition of the 
strategy (in terms of a gambling strategy Xt and a stopping strategy r) is 
now as follows: X = X^'^ is given by (14) and r = t^'^ by (15), at least on 
the set r > 0. 

Note that since we are in the case 7 < 1, maXs<tYs will be finite almost 
surely, and < 00. It is convenient to write Yt = maXsKtYg. Let HJ 
denote the first hitting time of level z hy Y, and set Az = A^jy. Recall 
that the situation has been reduced to the case y < Xq/j]. Then, assuming 
^00 > Xq/t], for Xq/t] < z < Yoo we have 

r]-Uo Yt r? - , Yt 

7] du V ^ f \ 

V-^Jxo/v u rj-^ \XoJ' 

Informally, the strategy {t^'^ , X^'^) can be described as follows. If Xt < 
(,Yt, then we stop immediately. We call this the stopping region S. If ^Yt < 
Xt < rfYt (and especially \i^y <x < -qy), then we take a fair gamble such that 
Xt jumps to an end of this interval immediately. We call this the gambling 
region Q. While Xt > rjYt, we set Xt to be constant. We call this the waiting 
region W. If the bivariate process {X, Y) is in W, then either Y eventually 
reaches the level Xt/ij and we reach the boundary between the gambling 
and waiting regions, or not, in which case Y tends to zero (provided 7 < 1), 
and T = 00. If the former, then on the boundary between Q and W we take 
a gamble which either makes the bivariate process jump to the boundary 
between S and G (and then we stop) or pushes the process (an infinitesimally 
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small distance) back into the waiting region W. (It is at this 
argument is informal; the precise description is given via 
above.) In this way, after perhaps an initial jump at time 
process is in (the closure of) W, it stays in this region, either 
until there is a jump from the boundary of W to 5 at which 
In particular, at no point do we ever enter the interior of Q. 

Now that we have described the martingale {Xt)t<T, the 
determine the value function associated with this strategy. 



point that the 
local times as 
zero, once the 
indefinitely, or 
point we stop. 
See Figure 1. 
next step is to 



Proposition 7. Suppose 7 < i? + r//(r/ — ^). Under the above strategy, 
specified by the thresholds {£,,r]), the value function is given by 

UR{x + y), x<iy, 
y) = { J{x,y), iy<x< rjy, 

K{x,y), W<x, 



where 
(16) 

and 
(17) 
with 



J{x,y) 



K{r]y,y) 



K{x,y) 



,1-Ri 



1 + 



l-R 



l-R 



+ ^1-73.7-^9 



l-R 

?? - e + ??(r?^"^(l + 0^"^ - !)/(! - R) 

v + iv-OiR-i) 




Fig. 1. Representation of the candidate strategy. In S we stop immediately, in W Xt is 
constant and we wait until Yt = rjXt if ever, and in Q we gamble, so that X leaves the 
interval [^Yt,riYt) instantly. 
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Now suppose J > R + i]/{r] — Then V^'^{x, y) = Ur{x + y) for x < ^y and 
infinity otherwise. 

Proof. The fundamental problem is to calculate 

V^^Hr]y,y)=E^y^y[URiXr + Yr)] 

where r = t'^'^ is the stopping rule defined above and X = X^'^ . The values 
for other starting positions can then be calculated easily using the martin- 
gale property in the gambling region, and the probability of reaching a new 
maximum in the waiting region. In particular, for S^y < x <r]y we have 



y'''5(x,y) 



X 



1 



7? 



and for rjy < x we have 



y^'«(x,y) = (^) 'v'^'Hx,x/r,) + 



1-7 



1-7 



l-R 



So, suppose {Xq,Yq) = {r]y,y). Recalling the definition of A^, and using 
7 < 1, we have 

F{Yr >Z)= P(iV^^ = 0|Foo > 2)P(Foo > Z) 

.. . 

exp(-^2)( 



where = (1 — 7) + (r// (r/ — ,^)). Further, 

F{Yr edz,T = 00) = exp(-i^)P(Foo G dz) 

'y^dz 
.z) z 

and on this event X^- = ijz and Yr = 0. It follows that 

r]-£,\zj z 

and on this set X^ = and Y^ = z. 

If we assume that 7 < i? + rj/{rj — ^), then R + (f)> 1 and 

V^'Hrjy,y) 

= E^y'y[UR{Xr + Yr)] 

roo /y\'l>dz 



z 
dz 



(1 -7) : ^ 



l-R 



ri-i 



l-R 



y (1-^) 



(1-7)7? 



l-R 



+ 



(1 + 



l-R 



-(!+</>) 



yi-Rj^i^R(^l + (1 _ i?)ry-(i-7)e) _ 1 
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where the last equahty rehes on a small amount of algebra. 
If 7 > + 77/(77 — then the integral near infinity of z~^~ 

□ 



is infinite. 



4.2. Optimal parameter choice. It is clear from the expression for K that 
in order to maximize the value function it is necessary to choose r] and ^ to 
maximize = 6/j(ry,^). We maximize over the set 77 > and —1 < < 77. 
The case r] = ^ corresponds to the choice r = inf{n '-Yu < x/r]} which was 
the class of stopping times considered in Section 3. 

Recall the definition of 7-(i?) from Definition 1. In this section we will 
generally assume that 7 < i? so that the condition 'y < R + r]/{r] — is 
automatically satisfied. 

Lemma 8. Suppose R<1. For < 7 < 7-(i?) the maximum 0/6^(77,^) 
is attained at ^*(7,ii) =i]*{'y,R) =w* where w* is the solution to (9). 

For 7-(-R) < 7 < -R the maximum of QR{r],(,) over ^ > —1, 77 > and 
r]>^ is attained at (r/*,C*) where 77* and ^* are given by 



(18) r, 
and 
(19) 

In this case, 



{R-i){l-R) 
R 



{R+l-j)-iR-^) 



-77 



(^+1-7 ) 

(i?-7) 

(77*)(i-t)/? 



{R-j){l + R-j)- 



Proof. For fixed 7 G (0,i?) we want to maximize Qr{i],(,). It is conve- 
nient to reparameterize the independent variables as rj and S = {rj — ^) /r], so 
that < 5 < 1 + 1/77. Then, if ^(r/, (5) = @R{ri,(), we have 



^ri,6) 



V 

l + (5(i?-7) 



6 + 



1 



l-R 



For fixed 6 it is clear that the maximum of <I> over 77 is attained at an interior 
point. However, this need not be the case for fixed 77, and the maximum 
value of $ may occur at 5 = 0. Thus we have to investigate the possibility 
of maxima of ^ which occur on the boundaries. We have 



(20) 



9$ 
dr] 



77 



l + 6{R--f) 



(1-7)U + 



(1-5 + 1/77) 



l-R 



l-R 



77(1 - 5 + 1/77)^ 
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and 



(21) 



'85 



{1 + 5{R-^)Y{1 
(1-7) 



-R) 

^)_SR{R-^) + {R-j)/rj 



{l-6 + l/r])R 

Setting both expressions equal to zero, and obtaining expressions for (1 
6 + l/rj)^ in each case, we find that at a turning point 

(1 - R)6{6rjR{R - 7) - (i? - 7 - rjR)} = 0. 

Hence, for fixed 77, there are at most two turning points given by 

Note that < ^2 only if r/ < (i? - 7) /R. 

Consider the turning point corresponding to 5i 



1 



0. For 5 
1 



l-R 



r]{l + l/ri)R_ 

Hence [recall (9)], (r/ = w*{'y),6 = 0) is a turning point of In order to 
determine whether this point is a (local) maximum it is necessary to consider 
the Hessian matrix of second derivatives. This is given by 

(y;*)-{l+7) 



;u>*,o) 



{w* + l){w* + {R--i)/{l-^)) 

' -{R--i{w* + 1)} {R--i{w* + l)}w*' 
{R--i{w* + l)}w* -R{w*f 

This matrix is negative definite, and hence the turning point is a local max- 
imum, provided < - ^{w* + 1) < R{w*y . 

The first inequality follows from Lemma 5. For the second, note that for 
small 7, w*{'^) is greater than 1 and R{w*)'^ > R — ^{w* + 1). This will 
remain the case until we first have R{w*)'^ = R — ^{w* + 1) or equivalently 
w* = {R — 'y)/R- Using the definition of r_ the necessity condition for a 
local maximum translates to 7 < 7_. Otherwise, for 7 > 7_, {w*{'y),0) is a 
saddle point. 

Now consider the value 5 = {R — ^ — ijR) /{rj{R — "y)R)- Substituting this 
expression into 5$ /d5 = we find 

'l + R--y 1-R\^ (l + R-j) 



R 



{l + R 
(1-7) 



7 Rr] 

We denote the solution of this equation by t]* where rj* is given in (18). For 
6 > 0, or equivalently r] < (R — ^) / R, we see that we need 7 > 7_. 
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Using ^ = 77(1 — 5) and 5 = (i? — 7 — r}R)/{rj{R — 'y)R) we obtain (19). 
Finally, substitution of rj* and ^* into ©rX?],^ gives that QR{r]*,(,*) = 

(ry*)i-^i?/((i?-7)(l + ii-7)). 

Note that for all values of 7 with < 7 < i? we have shown that there 
is at most one local maximum. It follows from consideration of on the 
boundaries that this is indeed the global maximum. □ 

4.3. The value function. Now we can state the solution to the optimal 
stopping problem (4). For 7 < the optimal stopping rule is to stop imme- 
diately, and for -y > R, there is no optimal stopping rule (in the sense any 
candidate stopping rule which is finite can be improved upon by waiting 
longer). These results are exactly as in the case of Section 3, and so atten- 
tion switches to the case < 7 < -R. The content of the next proposition is 
that for 7 in this range the optimal stopping rule is of the form described 
before Proposition 7, where the values of ^ and r] are chosen to maximize 
G(r?,0. 

Proposition 9. Suppose R<1. 

(i) For 7 < 0, y/(x,y) = C/r(x + 2/). 

(ii) For < 7 < 7_ the value function is given by V^{x,y) = ix,y) 
where w* solves (9). 

(iii) For 7_ < 7 < ii the value function is given by V^{x, y) = (rr, y) 
where Vj* and are given by (18) and (19). 

(iv) For J > R the value function is given by Vi{x,y) = 00. 

Proof. The proof in the cases (i) and (ii) follows the proof of Propo- 
sition 6, the only additional step being to check that the value function is 
concave in x. 

In case (iv) we know from Section 3 that if x > and 7 > ii, then there 
is a sequence of strategies for which wealth is constant and for which the 
value function is arbitrarily large. Since this strategy remains feasible in 
the case with gambling opportunities, the value function must be infinite 
in this case also. If x < 0, but x + y > 0, then it is possible to take an 
initial gamble such that with some probability the post-gamble wealth Xq 
is positive; and conditional on this event the value function is infinite. In 
this way we conclude that V^{x,y) = 00 for x > —y also. Finally, suppose 
7 = ii. Let rj = e and ^ = — 1 -|- e. Then @R{e, — 1 -|- e) = e"''' and for x > 0, 
V3{x,y) > V^'^^+%x,y) > y^~'-'x^~^@R{e, -1 + e) - 1/(1 - R). Hence, for 
x>0, V^{x,y) = 00 and this can be extended to a:; > —y by considering a 
suitable initial gamble as before. 

It remains to prove the result in the case 7-(ii) < 7 < ii. Proposition 7 
gives the value function for candidate strategies of a given form. The results 
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of Lemma 8 describe how to choose the optimal member of this class. It 
remains to show that it is sufficient to restrict attention to strategies of this 

type- 
write as shorthand for where the superscript is intended to 
denote the fact that this is a conjectured value function. Then for x < 

V''{x,y) = UR{x + y); for Cv <x<r}*y, 



V\x,y) ^ 



l-R 



and for x > yij* , 



v*-ei\y J" ' {R-j){l + R-^) 



+ (v*--]{i+ey 



^ " ' (i?-7)(l + i?-7)' 

Since is the value function associated with some admissible strategy 
[indeed the strategy associated with X and r as defined in (14) and (15) for 
the constants rj* and ^*], is a lower bound on the value function Vj' . 

In order to show that = Vi it will be sufficient to show that V'^{x, y) > 
Ur{x + y) and that V'^{Xt,Yt) is a super martingale for t <t, where r is any 
stopping rule such that {Xt + Yj) > for all t < t, and X £ X. This rules 
out Ponzi schemes for the wealth process Xt. 

The verification that V^{x, y) > Uii{x + y) is a lengthy but straightforward 
exercise. To prove that V'^{Xt^Yt) is a supermartingale for t <t we need the 
following lemma. 

Lemma 10. Suppose 7-(-R) <j<R, and suppose = . Then 

is concave in x so 

(22) V'ix + A,y)- V'ix, y) < AV,%x, y), 
and LXV^ < where 

(23) L^V = fiyVy + ^a^y^Vyy. 

Moreover, the first derivatives with respect to x and y of are continuous 
at X = ^*y and x = r]*y. 



Proof. Define the selling, gambling and waiting regions S, Q and W 
via 5 = {(x, y) : y > 0, -y < X < Cy}, G = {{x,y) :y > 0,^*y < x < r]*y} and 
W = {{x,y) :y > 0, r]*y < x} as above. 

Concavity in x: In S we have = {x + y)~^ and V^^ = —R{x + y)~^^^^^ < 
0. In Q, is linear in x with derivative = y~^{{ri*y~^ + {ri*y~'^Q* — (1 + 
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-R){V*-C))- Finally in W, = x"^ - {R--f)x~'^^+^~"'^y^~"'e* 
and V^^ = -Rx-(^+^\l - iyv*/xy-^) < 0. 

L^V^ < 0: In 5 we have L'^V = (x + y)~^^-^^hy^i{x/y) - (R - 
This is negative provided ^* < (i? — 7)/7 which follows from Lemma 5 and 
the fact that C <w*. In G, L^V = y^-^7]~^{l - -f)R{{x/y) - r]*) < 0. Fi- 
nally, inW, L^V = 0. 

Continuity of the derivatives at the boundaries S/Q and Q jYJ . Continuity 
of the derivatives and Vy follows from the identities 

/.,*\i--R_/i I t*\-'R 



(l + i?-7) 



(r,*)^-« = (l + e* 



and 

(i+r)""^ 

1 



(1 -e) 



l(i?-7)(l + i?-7)J"^'+^^ . 



□ 



Return to the proof of Proposition 9. Applying Ito's formula to (note 
that we need a version of Ito's formula which applies to functions of discon- 
tinuous martingales; see, e.g., Rogers and Williams [11], Theorem VI. 39.1) 
and using (22) and then (23), for any X € A", 

ftl\T 

V^Xt^r.YtKr) < V\x, y) + aYuV^ dWu 

tAT ptAT 



ptAT ptAT 

+ / ifiYu + ^a^Y^^y) du + / VS[Xu- , Yu) dX^ 
(24) 

< V%x, y) + aYuVy' dWu + V^{Xu- , Y^) dX^ 



= V%x,y)+Mt^r 

where M is a local martingale. 

Since i? < 1 it follows easily that is bounded below on the domain 
X + y >0. Hence the local martingale M^/^t- is a supermartingale and this 
property is inherited by V'^{Xt;^T-,Yt/\r)- In particular V'^{Xt/^T-,Yt;^T-) con- 
verges almost surely, and so does Xjat- Then by Fatou, 

KpRiXr + Yr)] < limmiE[V'{XtAr,YtAr)] < y%x, y) 
and it follows that = Vi. □ 



Note that Theorem 2 follows immediately on comparison of Proposition 
6 with Proposition 9. 
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5. Coefficients of relative risk aversion larger than 1. In this section 
we consider the problems (4) and (6) for the case R> 1. The case i? > 1 
introduces two new elements into the analysis. 

The first new element is the fact that the case 7 > -R becomes more 
complicated. When R < 1 and 7 > i? the value function is infinite. In this 
case the mean value of Y^~^ is growing, and there is both no great risk 
associated with small (and even zero) values of {X + Y) and a great reward 
from large values. However, when R> 1, the agent must avoid Xt + Yt = at 
all costs and the rewards for large {X + Y) are bounded above. The net effect 
is that when wealth x is fixed and negative, then it can never be optimal to 
allow X + Yt to hit zero, and there is a new nondegenerate solution in the 
case 7 > i? > 1. For example, for the problem in (6) we have: 



Theorem 11. Suppose 7 > > 1. 

Suppose X > 0. Then V^{x,y) = U{oo) = 1/{R-1). 

Suppose X < 0. Set z* = (7 — l)/(7 — i?) > 1 and for |x| < y < \x\z* define 



V'\x,y) 



l-(x + y)"(^-i) 



R-1 



and for \x\z* < y define 



V''ix,y) 



1 



R-l 

Then VJ'{x,y) = V^* {x,y). 



1 



(7 - 1)^"^ 



{R-l)R-^{-f-Rp~R 



|^|7-Ry-{7-i) 



Theorem 11 can be proved in a similar fashion to other results in this 
paper. However, we will not discuss the case 7 > i? > 1 in detail. Instead we 
will concentrate on the second effect of considering the case R> 1, which is 
that the fact that the objective function is not bounded below introduces 
new complications. 

The definitions of the critical ratios and the critical strategy do not change 
when we consider i? > 1, except that now we restrict attention to 7 < 1 rather 
than 7 < i?. As we shall see, the critical value of 7 at which gambling becomes 
useful is still given by the solution to Tji^^y) = 0, and ry*, Q* and the 
value function are still given by their expressions in Lemma 8. Furthermore, 
the proofs of Proposition 7 and Lemma 8 are unchanged [except that 7 < 
i? + 77/(77 — ^) is now automatic] and the lower bound parts of the verification 
lemmas (Propositions 6 and 9) are also valid. The only changes are in the 
proofs of the upper bounds. 

We concentrate on the upper bound in Proposition 9, since the situation 
in Proposition 6 is simpler and can be proved by identical ideas. The key 
issue is that when R <1 we can easily conclude that the local martingale M 
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in (24) is bounded below, and hence a supermartingale. When R> 1 this is 
no longer the case. 

There is an easy way to finesse the problem, which is to modify the defini- 
tion of X so that admissible pairs (r, X) must satisfy Xt + Yt > e > or more 
generally E[(inff<T-{Xf + < oo. In that case Mj^r is bounded below 

by an integrable random variable and hence a supermartingale. (A further 
alternative to the same effect would be to require that ({XtAr +YtAT})^~^ 
is uniformly integrable; see [4], Lemma 5.2.) However, this modification is 
unsatisfactory since it arbitrarily rules out strategies which should in any 
case be suboptimal — the optimal strategy involves liquidation before Xt + Yt 
gets too small — and it rules these out artificially rather than by this subop- 
timality property. 

Instead, we retain the definition of X so that Xt + Yt > for t < t. 
We want to find V/ = V/(xo,yo) for particular initial values Xq = xq and 
Yq = HQ. Typically we solve this problem by finding V^{x,y) for all initial 
values {x,y) simultaneously. Now we have to be slightly more careful. Given 
initial values {xo,yo), we replace the objective function U with a larger 
function U{x,y), which is bounded below. We now find the candidate value 
function V associated with U for all possible initial starting points. Since U 
is bounded below, we can prove that the conjectured value function V is the 
true value function 14 for objective function U. Finally, since U is chosen so 
that it agrees with U on the stopping set, we conclude the result we want 
that y*'^*(xo,2/o) = {xo,yo)- The key fact that makes this approach work 
is that for the optimal strategy the pair {Xt,Yt) is always stopped before 
getting close to the origin, or to the line x = —y. For this reason we can 
change the value of U on these neighborhoods without altering the value 
function at the starting point. 

Lemma 12. Suppose R> 1 and 7_(i?) < 7 < 1. Fix y > and define 
T) = {{x,y):0 <y <y,-y <x <r]y}. Define S = S r\V'^ , g = gr\V'^ and 
yV = W r\'D^ , where denotes the complement ofD. 

(i) Define U as follows: U = U on Q and W; on S, 





and on V 



U{x,y) = K* [yr]* ,y)-{v*y- x)K* {yrj* , y) 

= -A5y'-''ivl'-'' + xy-%T' 
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R (R-y),^^l^Rf{l+R-j) X \ 1 



i + R-j)'' V (i?-7) v*yJ 1-^ 

where K* is the function in (17) evaluated at r]* and ^* . Then U >U and 
U is bounded below. 

(ii) Define V via V = U on S and T) and V = V^*'^ on Q and VV. Then 
V{Xt.,Yt) is a supermartingale, and for all X ^ X , 

(25) V{x,y)> sup W^y[U{Xr,Y^)]. 

T,X<^X 



Proof, (i) On 5, U is constructed such that the value and first x- 
derivative match those of U at ^*x. Since U is linear in whereas U is 
concave, we have U >U on 5. 

Similarly, on [/ is constructed such that the value and first x-derivative 
match those of at (riy,y). Since U is linear in x, whereas is concave, 
we have U >V^ >U on D. 

(ii) Exactly as in the proof of Proposition 9, it will follow that V{Xt,Yt) 
is a supermartingale provided that V is convex in x, L^V < and the first 
derivatives of V are continuous at the boundaries between 5, Q, VV and V. 
It then follows that 

V{XuYt)<V{x,y) + Mt 

[recall (24)], where Mj is a local martingale which is bounded below, and 
hence a supermartingale. 

Let J*{x,y) and K*{x,y) denote the functions J and K defined in Propo- 
sition 7, but evaluated using the optimal parameters rj* and Then in S, 
U{x,y) = J*{x,y) where the domain of J* has been extended from G into 
iS. It follows that V is linear in S and G, and in D linearity follows by 
construction. In W convexity of V is guaranteed by Lemma 10. 

Similarly, the fact that L^V < follows immediately in 5, ^ and VV, and 
in T) it is easy to show that L^V = 0. 

Finally it is necessary to check that the first derivatives of V are contin- 
uous at the boundaries. For the x-derivative on the W/V boundary, this 
follows by definition and the only nontrivial derivative to check is the y- 
derivative on the Q/V boundary, or equivalently on the S/V boundary. The 
equality of the derivatives on either side of the boundary follows by direct 
calculation, or by using the fact that in G and S 

V{x,y) = J*{r]*y,y) - {r]*y - x)J*{7fy,y) 

whereas in D, the same formula remains true but with J* replaced by K* . 
Using this second method, the result follows from the fact that K*^{r]*y, y) = 
0. 
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Given that V{Xt,Yt) is a super martingale it is a short step to prove (25). 
Note that on Q and VV, 

V = 1/^*'?* >U = U 

so that V >U everywhere. Then 

V{x,y)> sup E[ViXr,Yr)]> sup E[UiXr,Yr)]. 

T,xex T,x&x L-i 

Proposition 13. Suppose R> I and 7 < 1. 
{i)Forj<0,V,^{x,y)=UR{x + y). 

(ii) For < 7 < 7„ i/ie ua/ue function is given by V^{x,y) = {x,y). 

(iii) For < 7 < 1 the value function is given by V^{x,y) = {x,y)- 

This leads immediately to the following analogue of Theorem 2. 

Theorem 14. Suppose R> I and 7 < 1. For 7 < 7-(i?) we have that 
= y*- Conversely, for 7_(i2) < 7 < 1 we have that VJ" < . 

Proof of Proposition 13 in the case 7_ < 7. Suppose {x,y) is 
such that x > (,*y. Fix y < y, and use this y to define T>, S, Q and W as 
in the lemma above, together with U and V. Note that either G ^ or 

{x,y)eW. 

We know from consideration of the strategy {t^* , X^* ) , which we 
abbreviate here to (r*,X*), that 

y^*'«*(x,y)=E[C/(X;*,y,0]< sup E[?7(X„y,)] =K?(x,y). 

T,X&X 

Now let (t, X) be any admissible strategy. Then, by a simple comparison 
and Lemma 12, 

¥.[U{X^,Y^)]<nU{Xr,Yr)]<V{x,y). 

Finally, since G ^ U VV, in which region y = we have ¥.\U{Xr, 

Yr)] < V'!*^^\x,y) and Vi = T/^*'«*. 

Now suppose that x <^*y. For fixed risk aversion i?, the optimal ratio ^* 
is decreasing in 7. Let 7 > 7 be such that ^*(7) =x/y, and let Y denote the 
solution to (2) for this parameter value. Then 

Thus 

(26) sup nU{Xr,Yr)]< sup E[[/(X„i;)] = ^^±fl^— 

where this last equality follows from the fact that if x = £,*{'j)y, then it is 
optimal to stop immediately. Since there is equality in (26) for r = we have 

^/(x,?/) = T/^*'«*(x,y) = U{x,y) for x < ^y. □ 
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6. Conclusions and further remarks. 

6.1. Logarithmic utility. The results for the case of logarithmic utility 
can easily be recovered by taking the limit i? — > 1. For example, the equation 
r/j(7_) = can be rewritten as 



Letting — > 1 we find that 7_ = 7_(1) is the unique solution in (0, 1) to 



In a similar fashion we can let ii — s- 1 in the defining equations for w* , , 
r]*, ^* and V^'^. In this way we can deduce the results for logarithmic utility 
from Propositions 9 and 13. 

Corollary 15. Suppose U{x) = In x andj<l. For 7 <7„(1) we have 
that KT = y* ■ Conversely, for 7_(1) < 7 < 1 we have that VJ" < Vi . 

6.2. Other limiting cases. It is interesting to consider the limiting cases 
R [0 and j 00. As i? J, the utility function approaches linear and j-iR) 
approaches zero. If 7 < 0, then it is always optimal to sell the real asset 
immediately, whereas if 7 > 0, it is optimal to hold onto the real asset in- 
definitely. 

Conversely, in the limit i? | 00, 7-(-R) — > 1. In this case, for 7 < 1 it is 
never optimal to gamble. Let E{w) = limfj-^oo{R — 1)Ur{1 + w/{R — 1)); 
then E{w) = 1 — e"*". In this sense at least the limit i? j 00 corresponds 
to exponential utility. The optimal sale problem for exponential utility has 
been studied by Henderson [3]. For exponential utility wealth factors out of 
the problem, so the value function is always concave in x. 

6.3. Convexities and gambling in related models. The main phenomenon 
which our model attempts to capture is that the timing option (discretionary 
stopping) and market incompleteness potentially induce a convexity in the 
value function, and this encourages the risk-averse agent to gamble. 

Convexities of this form, and the consequent predictions of risk-seeking 
behavior, can arise in other ways. First, the objective function may itself be 
convex, for example if the agent has limited liability with respect to losses. 
(The agent then "gambles for resurrection." ) Second, a convexity may arise 
from an interaction between discounting and consumption, as the following 
example, slightly modified from Karatzas and Wang [8], illustrates. 
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Consider the problem of finding, for a positive "discount factor" p > 0, 

(27) y/^y/(x)= sup E[e-^nn(XO], 

T,X&X 

where 

(28) X = {Xt : E[Xo] = x; Xu > 0, u < r; X is a cadlag martingale}. 
Define also 

VJ" = VJ'ix) = supE[e-^nn(x)]. 

T 

It is easy to see that 

K"(x) = (lnx) + . 

(When X < 1 the agent can defer r indefinitely, and the presence of the 
discount factor encourages him to do so.) 

The function V^{x) is not convex. It follows that the agent who can 
undertake a gamble at time should do so, and that 

(x) = (lnrc)/|^>e} + (x/e)/{^<e}. 

For x>e, the optimal stopping rule is r = 0. For x < e there is no optimal 
strategy, but there is a sequence of strategies indexed by m G N, with as- 
sociated value functions which converge to . These strategies involve an 
initial fair gamble at time 0, after which wealth is either e or x/m [with 
probabilities p = x{m — 1)/ (em — x) and 1 — p, resp.] . 

It should be noted that the objective function e~^'^lnx has some perverse 
features, and the interpretation of p as a discount factor is hard to justify in 
economic terms. When there is no uncertainty and x > 1, the agent prefers 
r = 0, since endowments received later are less valuable. However, when 
x < 1, the agent prefers to take r as large as possible. In this case the agent 
prefers a (certain) payout later rather than sooner, which is inconsistent with 
the standard interpretation of discounting. Effectively, the fact that losses 
can be deferred indefinitely introduces a gambling for resurrection element 
into the problem. Note that since there is no discount factor in our problem, 
there is no relationship between the causes of the incentives to gamble in 
the Karatzas and Wang [8] model, and in the model of this paper. 

The above examples illustrate that there are many reasons why agents 
facing optimization problems may seek to take outside gambles. Sometimes 
these reasons may be traced back to a convexity in the objective function. 
In contrast, in our model the incentive to gamble arises from an interaction 
between the timing option over when to sell, and the market incompleteness. 
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6.4. Concluding remarks. In this article we have given an exphcit solu- 
tion to a mixed optimal control/optimal stopping problem. Associated with 
the explicit solution for the value function is an explicit element X £ X. 
This control can be characterized in terms of a local time on a ray. The 
optimal pair {Xt,Yt) receives a local time push to keep the process within 
the region Xt > r]*Yt, and to preserve the martingale property of X there 
are compensating downward jumps. Thus, even though the setup involves 
continuous processes, it is necessary to introduce discontinuous processes in 
order to define the optimal wealth process. 

In the case of relative risk aversion coefficients less than 1, the proof can 
be completed by conjecturing the form of the optimal strategy, and then 
using a verification lemma. When i? > 1 the fact that the objective function 
is unbounded below introduces significant extra complications. However, it 
is intuitively clear that the conjectured strategy is still optimal, since the 
optimal strategy is to sell immediately when wealth is small. This gives us 
the key to proving optimality in this case: we modify the objective function 
on parts of the space that the optimal controlled process never reaches; 
for this modified problem the value function is bounded everywhere, but the 
solution is equal to the solution of the original problem at the starting point. 

The most interesting feature about the problem is that the solution is not 
as might be predicted. Instead, although the agent is fully rational and risk 
averse, the incompleteness of the market and the presence of the American- 
style timing option to sell the real asset induces her to gamble. 
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